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Description 

BACKGROUND OF THE INVENTION 
5 1. Field of the Invention 

[0001] This invention relates generally to a sensing system for deploying an airbag and, more particularly, to a sensing 
system that uses reflected, non-visible, near-infrared radiation to detect human facial features to determine a person's 
position relative to an airbag for proper airbag deployment. 

10 

2. Discussion of the Related Art 

[0002] The National Highway Traffic Safety Administration requires passenger side airbags on all passenger cars 
manufactured after 1998. Airbags have saved thousands of lives, but safer airbag deployment systems can save even 
15 more lives. Proposals have been submitted by the National Highway Traffic Safety Administration to require advanced 
airbags that are safer and more efficient. Thus, there is a need in the art for an advanced airbag deployment system 
that determines airbag deployment depending on the detection, identify and tracking of a person in the passenger seat 
of the vehicle. 

[0003] Future airbag deployment systems will be able to identify and track a person in the passenger seat of the 

20 vehicle. Based on this information, the system will provide signals whether to fire the airbag, fire the airbag at low 
velocity or fire the airbag at normal high velocity during a crash event, depending on whether a person is seated in the 
passenger seat, the size of the person and the position of the person relative to the airbag deployment door. In one 
example, if a person is detected in the passenger seat, and is some small distance (for example, within three inches) 
from the airbag door, then the airbag does not fire during a crash event. If a person is detected in the passenger seat, 

25 and is close (for example, between three and eight inches) to the airbag door, the airbag is fired at a lower velocity 
during a crash even. If the person is detected in the passenger seat, and far enough away (for example, more than 
eight inches) from the airbag door, then the airbag is fired at normal high velocity during a crash event. 
[0004] Present passenger sensing systems typically include ultrasonic, weight, infrared and/or electromagnetic sen- 
sors to detect a passenger for airbag deployment. Ultrasonic sensing systems sense the motion of objects within the 

30 passenger seat area and determine whether the object is moving closer or farther away from the sensor location. 
However, ultrasonic sensors don't identify the nature of the object, and thus can't tell if it is a person or some other 
object, such as a bag of groceries. Similar to ultrasonic sensors, microwave sensors employed in active doppler radar 
systems can track objects, but cannot identify human presence. Weight sensors identify objects in the passenger seat 
based on applied pressure, but don't consider the passenger's location relative to the airbag. Passive IR sensors 

35 acquire thermal images of the passenger seat, but these systems are very costly. Present active IR sensors sense the 
relative location of the passenger relative to the airbag, but cannot identify human presence. Electromagnetic systems 
include LC resonant circuits where body capacitance is used to detect presence and identify objects, but these systems 
can not track the objects. 

[0005] U.S. Patent No. 5,835,61 3 issued to Breed et al., November 10,1 998, discloses a vehicle interior monitoring 
40 system that claims to identify, locate and monitor persons in the passenger compartment of the vehicle. The monitoring 
system employs infrared emitters that illuminate the interior of the vehicle, and charge couple device (CCD) arrays that 
detect the radiation. Outputs from the CCD arrays are analyzed by computational devices that employ pattern recog- 
nition algorithms to classify, identify or locate the content or objects in the passenger seat. The pattern recognition 
system for determining vehicle occupants disclosed in the '613 patent employs complicated software that must learn 
45 the shape of an individual in all kinds of lighting situations under various conditions. Additionally, employing pattern 
recognition in this manner is limited in its ability to track the individual as he or she moves around in the passenger 
seat. Further, the ability to identify and track humans by general pattern recognition is questionably unreliable. Pattern 
recognition cannot identify who the person is, only detect an object's shape. 

[0006] US 5,829,782 discloses another vehicle interior monitoring system that is capable of detecting the presence 
so of a passenger in a front seat of a vehicle and determining the distance of the person from an airbag mounted in an 

instrument panel of the vehicle. This document discloses the use of ultrasonic transceivers that emit ultrasonic waves 

toward the vehicle interior and detect returning waves. The distance of the person from the airbag is calculated from 

the time period required for the waves to travel from the transducers and return. If the occupant is sufficiently close to 

the airbag, the deployment of the airbag is suppressed. 
55 [0007] What is needed is an improved airbag deployment sensor and system that is able to effectively identify and 

track a person in the passenger seat of a vehicle. It is therefore an object of the present invention to provide such a 

sensing system for vehicle passenger airbag deployment. 

[0008] To achieve this object, the present invention provides a system having all the features of claim 1 and a method 
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having all the features of claim 13. 

[0009] In accordance with the present invention, a vehicle occupant airbag deployment system is disclosed that 
detects the presence of an object in the passenger seat of a vehicle, verifies that it is a person, tracks the person's 
location and provides a signal for no fire, soft fire, or hard fire of the airbag depending on the location and/or size of 

5 the person during a crash event. The airbag deployment system employs short wavelength infrared emitters that emit 
an infrared signal towards the passenger seat of the vehicle, and an infrared detector, such as a CMOS sensor used 
as a video signal array, that receives reflected infrared illumination from objects in the seat. Processing circuitry, in- 
cluding face recognition software, is employed to detect a human face to provide the necessary reliable detection 
identification, and tracking of the person. In this manner, the system prevents the airbag from firing if the passenger 

10 seat is not occupied by a person, prevents the airbag from firing if a person is detected, but is too close to the airbag, 
and provides a soft fire if a person is detected, but is within a soft fire range of the airbag. Also, if the person is a child 
or small female, the system can prevent airbag firing. 

[001 0] Additional objects, advantages and features of the present invention will become apparent from the following 
description and appended claims, taken in conjunction with the accompanying drawings. 

15 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0011] 

20 Figure 1 is a side, cut-away, plan view of a person in the passenger seat of a vehicle in connection with an image 

sensing system for airbag deployment, according to an embodiment of the present invention; 
Figure 2 is a perspective view of a video camera and LED illuminator unit employed in the airbag deployment 
system of the present invention; 

Figure 3 is a graph with wavelength on the horizontal axis and luminous energy on the vertical axis showing the 
25 luminance curve for sunlight; 

Figure 4 is a representation of camera orientation and position parameters with respect to the center and normal 
of the airbag door; 

Figure 5 is a block diagram of the airbag deployment system of the present invention; 

Figure 6 is a schematic diagram depicting a frame differencing technique used in the airbag deployment system 
30 of the present invention; and 

Figure 7 is a timing diagram for the frame differencing technique of the invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

35 [0012] The following discussion of the preferred embodiments directed to an airbag deployment system that employs 
human facial feature recognition is merely exemplary in nature, and is in no way intended to limit the invention or its 
applications or uses. 

[0013] According to one embodiment of the present invention, a technique for detecting, identifying and tracking a 
person in the passenger seat of a vehicle is disclosed. As discussed above, it is sometimes desirable to deploy a 
passenger side airbag in a vehicle at low velocity, or not deploy the airbag, during a crash event, depending on whether 
a person is occupying the passenger seat of the vehicle, the proximity of the person to the airbag door, and the size 
of the person. According to the present invention, the identification and tracking of the person is determined by face 
recognition software, in particular, software that recognizes and tracks the person's eyes and other facial features. 
Tracking can take place that way at many head angles and poses. The software algorithm would use calibrated face 
45 and feature separation to estimate range. The tracking of a localized area on the human face allows more image frames 
to be acquired per second, permitting more frequent tracking of the person. The more frequent tracking of the facial 
features will prevent acquiring a blurry image because the image is updated more frequently. 

[0014] Various software is known in the art that processes data from video data patterns received from an object 
being analyzed, and determines whether the object has a face. For example, such software includes the Visionics 

so Face-It software, well known to those skilled in the art. It is stressed that the present invention is not limited to any 
particular facial feature mapping function, but can include any known algorithm, suitable for the purposes described 
herein, for recognizing facial features, whether it be two-dimensional or three-dimensional, that are then also to be 
used for ranging functions, as well. Further, according to the present invention, ranging algorithms are used in cornbi- 
nation with the know face recognition software. 

55 [0015] As will be discussed in detail below, the present invention employs infrared radiation reflected off of objects 
in the passenger side of the passenger compartment of a vehicle that is received by an electronic video camera. The 
video camera generates the electrical signals and image used by the face recognition software to determine the pres- 
ence identify and tracking of the person. 
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[0016] Figure 1 is a cut-away, side, plan view of the passenger side compartment 10 of a vehicle 12. In this depiction, 
a person 16 is shown in the passenger seat 18, where the person 16 is moving forward during a crash event. An airbag 
pillow 20 is shown being deployed through an airbag door 24 housed in an instrument panel 22 during the crash event. 
[0017] A video camera and IR LED illuminator unit 26 is mounted on the instrument panel 22 at a location suitable 

5 for the purposes described herein. Figure 2 is a perspective view of the unit 26 removed from the vehicle 12. The unit 
26 includes a cluster 28 of IR LEDs 30. A plurality of LEDs 30 is provided to generate the necessary intensity for 
daylight operation. The cluster 28 emits a beam of IR radiation towards the person 16 that is reflected therefrom back 
towards the unit 26. A video camera 34 is provided in the unit 26 to receive the reflected radiation from the person 16. 
The video camera 34 is used by way of a non-limiting example in that any detector that detects infrared radiation 

10 suitable for the purposes described herein can be used. 

[0018] A filter 36 is provided over the camera 34 to filter out radiation that is not within the desirable infrared range. 
The filter 36 can be any filter suitable for the purposes described herein, such as a Ti0 2 filter or a polarizing filter. The 
filter layers and thickness can be chosen to transmit the IR image to the detector, but to reflect the visible image away 
from the detector. The polarizing filter can be used to reduce visible light to the detector using electro-optical polarization 

15 that passes the IR wavelengths, but strongly attenuates the non-IR wavelengths. Figure 3 shows the luminance curve 
for sunlight, where the filter 36 passes infrared radiation in the 40 nm bandpass window. The filter 36 provides some 
protection against sunlight that may affect the operation of the airbag deployment system, and recognition of the face 
of the person 16. 

[0019] In this embodiment of the present invention, a single camera is used to acquire and monitor the range of the 
20 person 16. The software employed to perform this function . utilizes two separate locations on the occupant's face to 
provide the ranging. In a preferred embodiment, it is the person's eyes that are detected to provide the triangulation 
for ranging purposes. However, as will be appreciated by those skilled in the art, other facial features of the person 16 
can also be used, such as the person's ears, etc. Also, the software algorithm allows the person's head size to be 
determined so that both eyes do not need to be in view to track the person after he has been acquired. Additionally, 
25 the software can be used to view other parts of the person's body, such as the person's torso, in combination with the 
facial feature or head size detection. 

[0020] Because human facial features are unique, a database can be used to store specific information, such as 
eye-to-eye separation, about a person, so that the software can particularly identify that person. This is important, in 
one example, so that the system can identify children and fifth-percent females, and inhibit air bag firing for these 
3b people, as required by government mandated regulations. Also, being able to specifically identify a person improves 
the ranging accuracy of the system because the system knows that person's eye separation or other specific facial 
features. 

[0021] The acquisition and tracking software needs to be calibrated for a particular seat position, airbag position, 
vehicle makeup, etc. Figure 4 is a representation of the camera orientation and position parameters with respect to 

35 the center and normal of the airbag door 24. The three parameters that must be estimated in the vehicle for ranging 
according to the invention after the camera and Visionics Face-It software are calibrated include two position offsets 
and one angular offset. The two position offsets are the lateral offset of the camera 34 with respect to the center of the 
airbag (AY), measured laterally and perpendicularly to the normal vector out of the center of the airbag door 24, and 
the front or back offset (AX) of the camera 34 with respect to the center of the airbag door 24, measured along an axis 

40 parallel to the normal out of the center of the airbag door 24. The angular parameter is the azimuth offset (AO) between 
the optical axis of the camera 34 and the normal vector coming out of the center of the airbag 20. Only two of these 
parameters, AX and AO, are used in the modified monocular distance equation. 

[0022} A calibration procedure, described below, can be used to determine AY, AX and AO. There is a trade off 
between measuring a large number of calibration points and linearly interpolating between them or measuring a small 

^5 number of calibration points and non-linearly interpolating between them. In theory, calibrating with a large number of 
points would not require a model for estimating that is described herein. The cost of making the large number of 
measurements necessary for a brute force calibration and the possibility that out of range operation of the camera 34 
or software might occur unnoticed with brute force calibration must be considered before using that approach. The 
approach used herein uses a small number of calibration tests in order to form a model for interpolation. 

so [0023] From Figure 4, the following equations can be written in order to relate measurements made in the airbag 
door reference frame (xyz) to those made in the camera lens reference frame (xyz). Only face positions in front of the 
airbag door (x>o) are considered in the following equations. For p,6 (pitch or elevation angle) and $ (yaw or azimuth 
angle) defined in the cameras spherical coordinate system, the equations for displacements x and y in the airbag 
coordinate system are: 

55 

x=-AX+psin(e+A8)cos(4>+AO) (1 ) 
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15 



y=-AY+psin(e+A6)sin({|)+AO) 
This assumes that 6 + A0 is fixed during the calibration. Rearranging equations (1) and (2) yields: 

^=tan«, + A<I>) 



(2) 



(3) 



Making eye coordinate readout measurements at fixed x+AX, and then taking the slope of the tangent with respect to 
io changes in y yields: 



hed x = 



dtan($ + A<P) 
dy 



(4) 



[0024] Knowing x and the result on the right side of equation (4), AX can be determined. Knowing AX, equation (3) 
and the measured data can be used to determine AY. Then, using AX and AY, equation (3) and the data, AO can be 
determined. Using equation (3), and the fact that: 



eye_separation_distance=y rt _ eye -y lefteye 



(5) 



the modified monocular equation follows from equation (6) for defining the objective parameter x, or the eye to airbag 
25 distance. 



30 



40 



x = -AX + 



eye_separation_distan ce 



(6) 



[0025] The calibration table consists of a lookup table of the SDK determined eye coordinate as a pixel value linked 
to the associated ray slope, as viewed in the camera coordinate system. Equation (6) can be simplified in terms of ray 
slopes (tangents of singular angles), so that the calibration table can be used directly to determine the eye to airbag 
distance from monocular operation. Employing the tangent trigonometry identity in equation (7) below, 



tan(a + b) 



= tan(a) + tan(b) 
1 -tan(a)tan(/j) 



(7) 



and applying this identify to equation (6), leaves the modified monocular equation in a form that can be used by direct 
look up of tangent/slopes from the calibration lookup table. This equation is given in equation (8) below. 



55 



-AX + 



eye_separation_dis\an ce 

te/7((t> /eft _ ey9 )+tan(AO) tan(4> rf _ eyB ) + tan(AO) 



1-tan(<|>, e ^ ye )tan(AO)~ 1-tan((}> rt _ eye )tan(A<J>) 



(8) 



[0026] Figure 5 is a block diagram of an imaging system 50 of the invention including a digital signal processor (DSP) 
52. The DSP 52 includes the face recognition software and ranging functions that performs the analysis on the image 
generated by the camera 34. A clock generator 60 provides timing for the various digital devices in the system 50, and 
a power management system 62 provides the power. The DSP 52 is connected to a CMOS chip 70 including a pixel 
array 72 that represents the IR detector, such as the camera 34. In this example, the pixel array 72 includes 256x256 
pixels to provide the desired level of resolution. The CMOS chip 70 also includes various elements for timing and 
control purposes, including state matching logic 74, clock/timing circuitry 76, analog conditioning circuit 78, registers/ 
buffers 80, on-chip programmable logic circuitry 82, etc. Additionally, an analog-to-digital converter 84 is also provided 
to convert the analog signal from the pixel array 72 to a representative digital signal. An on-chip SRAM memory 86 is 
shown for storage purposes, but can be off-chip as well. The operation of these devices in the system described herein 
would be apparent to those skilled in the art. 
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[0027] In one embodiment, the infrared LEDs 30 are continuously on to provide the reflected radiation received by 
the camera 34. However, typically some kind of filtering or signal processing must be done to correct for the problems 
caused by direct sunlight on the camera 34 that make it through the filter 36. Particularly, the system 50 needs to be 
able to distinguish between shadows caused by sunlight and actual edges of features on the occupant 16. According 

5 to the present invention, a frame differencing technique is employed that synchronously pulses the LEDs 30 on for a 
predetermined period of time and a predetermined number of frames of video data, and then off for a predetermined 
period of time over the same number of frames of video data. Then, the frames of data are subtracted from each other 
so that the frames without IR illumination can be subtracted from the frames with IR illumination, and the background 
can be eliminated. The detector is electronically shuttered synchronously with the pulses to provide exposure control. 

10 The frame differencing technique described herein is used in conjunction with the infrared pulsing to achieve the desired 
result. In other words, the frame differencing is synchronized to the infrared pulses. 

[0028] The concept of frame differencing is the time-aperture, pixel-level storage of images using natural illumination 
only and natural illumination with added infrared illumination. Frame differencing allows these images to be subtracted 
to mitigate the effects of strong visible illumination. The set-up includes a neutral density filter that sets the IR illumi- 

15 nation, plus worst case background to maximize analog-to-digital converter input. Face recognition requires that the 
worst case analog-to-digital range for the differenced image be 5 to 6 bits. The visible light would fit within the remaining 
range allowed by the analog-to-digital converter. The image differencing is either performed in the analog domain, 
where two pixel level capacitors are charged, one at each illumination level, or in the digital domain where a RAM 
memory of the digitized pixel output is taken at each illumination. The frame differencing acts to subtract out the illu- 

20 mination effects of the visible illumination, and to improve the image contrast. The frame differencing function can be 
performed in the acquisition/high bandwidth generation mode or in the narrow bandwidth track mode using pulsed LED 
illumination. The number of the electrons from the pulsed IR light source must be 10 times greater than the photon 
noise of the ambient illumination. Here, the noise of the ambient illumination is the square root of two times the number 
of electrons within the sun intensity, because two image frames are being acquired for every one IR image received. 

25 [0029] Figure 6 is a representation of how the frame differencing is performed in the camera 34, according to one 
embodiment of the present invention. Figure 7 is a signal timing line showing the operation of the frame differencing 
technique of the invention. A pixel array 90 in the camera 34 receives radiation from the scene for a predetermined 
time period (10 us) during a pulse of IR from the LEDs 30. At this time, the pixel array 90 receives ambient light and 
infrared (ight. The charge stored by each pixel or photodiode 92 in the array 90 is then transferred to a charge storage 

30 site 94 made up of a plurality of capacitors, one capacitor 96 for each pixel 92. About 10 u.s later, at the end of the 
pulse from the cluster 28, the pixel array 90 detects just the ambient light for the same time period. The charge received 
by the pixel array 90 at this time period is stored in a capacitor storage site 98, having capacitors 1 00. An electronic 
shutter is employed in the detector to open and close at the appropriate time synchronously with the pulses of IR 
radiation for the operation described herein. 

35 [0030] The two storage sites 94 and 98 are summed in a summation amplifier 102. The difference between the two 
storage sites 94 and 98 is then digitized by an analog-to-digital converter 104, and represents the frame of data where 
the ambient light has been removed. The readout of data takes about 10 ms, then at the next time period, the next 
pulse from the cluster 28 occurs. The complete frame differencing process can be performed on a single chip in CMOS 
where the pixel array 90 and the storage sites 94 and 98 are together. In an alternate embodiment, the frame differencing 

40 is performed at a different time period at an off-chip site, where the storage sites 94 and 98 are RAM. 

[0031] The frame differencing technique of the invention can be described in the following manner. The variables 
are defined as ambient illumination l(x,y), direct ambient illumination T(x,y), scene reflectance R(x, y), and modulated 
source as L when on, and 0 when off. The response of the camera 34 is proportional to the product of reflectance and 
illumination. 

45 

S(x,y,OFF) = k*(l(x,y)*R(x,y)) 



S*(x,y,ON) = k*((L+l(x,y))*R(x,y))+T(x,y) 



D(x,y) = S(x,y,ON) - S(x,y,OFF) = KL*R(x,y) 

55 This difference scene has much smaller dynamic range than the simple image S(x,y ( OFF). The same benefit can be 
derived by reading out the frame with LED, then reading the frame without LED and subtracting the frames external 
to the camera 34. The penalty is increased dynamic range required to avoid saturation. 

[0032] L must be much greater than the photon noise on I. Thus, I is made as small as possible by using a narrow 
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bandpass filter aligned in frequency to L. The raw sampling rate has to be twice the requirement set by the object 
tracking because two frames are differenced to get one frame to supply the face recognition software. The LEDs 30 
have to be much faster. The IR radiation source has to be modulated such that all emission is during the time when 
all detectors are active. If the integration times of all pixels in the detector are not aligned, the available time for the 
5 source to be ON is reduced by the worst case misalignment. 

[0033] The foregoing discussibn discloses and describes merely exemplary embodiments of the present invention. 
For example, a pulsed laser diode could be used in place of the LEDs. One skilled in the art will readily recognize from 
such discussion and from the accompanying drawings and claims, that various changes, modifications and variations 
can be made therein without departing from the scope of the invention as defined in the following claims. 

10 

Claims 

I. A system for deploying a passenger airbag (20) in a vehicle (12) for restraining a passenger (16), said airbag (20) 
is being mounted in an instrument panel (22) of the vehicle (1 2) in front of a passenger seat (1 8), said system com- 
prising: 

an infrared source (30) generating an infrared beam directed towards the passenger seat (18); 
an infrared detector (34) responsive to infrared radiation reflected from objects in the passenger seat (18), 
20 said detector (34) generating signals indicative of an image of the objects in the passenger seat (18) based 

on the reflected infrared radiation; and 

a processor (52) responsive to the image from the detector (34), said processor (52) including face recognition 
software that identifies, acquires and tracks facial features of the passenger (16), said processor (52) causing 
the airbag (20) to deploy in a crash event if the passenger (16) is detected in the passenger seat (18) and is 
25 a predetermined distance away from the instrument panel (22); 

characterized in that the processor (52) determines the distance the passenger (16) is from the instrument panel 
(22) by the separation distance between two locations on the passenger's face. 

30 2. The system according to claim 1 , wherein the processor (52) tracks the passenger's eyes and determines the 
distance the passenger (16) is from the instrument panel (22) by the separation distance of the passenger's eyes. 

3. The system according to claim 1 , wherein the infrared source (30) is a cluster (28) of infrared light emitting diodes. 

35 4. The system according to claim 3, wherein the infrared detector (34) is an electronic video camera. 

5. The system according to claim 4, wherein the cluster (28) of diodes (30) and the electronic camera (34) are provided 
as a single unit (26) mounted to the instrument panel (22) in front of the passenger seat (18). 

40 6. The system according to claim 1 , further comprising an infrared filter (36) positioned in front of the detector (34). 

7. The system according to claim 1 , wherein the infrared detector (34) includes a pixel array (90) of photodiodes (92). 

8. The system according to claim 1 , wherein the infrared source (30) is pulsed on for a predetermined time at pre- 
45 determined intervals. 

9. The system according to claim 8, wherein the pulsed source (30) and the detector (34) are synchronized such that 
a difference of successive frames represents an image free of ambient light variations. 

50 10. The system according to claim 9, wherein said difference of successive frames is directly performed by the detector 
(34). 

II. The system according to claim 1, wherein frames of data are stored in the detector (34) when the source (30) is 
on and the source (30) is off to subtract out visible light. 

55 

12. The system according to claim 1, wherein the processor (52) includes a database that stores information about 
specific individuals, said processor (52) using the database to identify the passenger (16). 
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13. A method of determining whether to deploy a passenger airbag (20) in a vehicle (12), said method comprising the 
steps of: 

directing a beam of infrared radiation towards a passenger seat (18) of the vehicle (12); 
s - detecting reflected infrared radiation from objects in the passenger seat (18); 

generating signals indicative of an image of the objects in the passenger seat (18) based on the reflected 
infrared radiation; 

processing the image signals with the use of face recognition software to determine whether a person (16) is 
in the passenger seat (18); 

10 - determining a distance of the person (16) in the passenger seat (18) from the instrument panel (22); and 

determining whether to fire the airbag (20) by whether a person's face is detected and that person's distance 
from the instrument panel (22); 

characterized by the step of determining the distance the person (16) is from the instrument panel (22) by the 
15 separation distance between two locations on the person's face. 

14. The method according to claim 1 3, wherein the step of processing includes recognizing and determining a person's 
face by his or her eyes. 

20 15. The method according to claim 13, wherein the step of determining whether to fire the airbag (20) includes deter- 
mining whether to soft fire or hard fire the airbag (20) by the distance of the person (16) from the detector (34) 
and/or the size of the person (16). 

16. The method according to claim 13, wherein the step of directing the beam of radiation includes pulsing the beam 
25 of radiation. 

17. The method according to claim 16, further comprising the step of employing a frame differencing technique to 
subtract ambient radiation from detected images. 

30 

Patentanspriiche 

1. Ein System zum Entfalten eines Beifahrer-Gassackes (20) in einem Fahrzeug (12) zum Zuruckhalten eines Bei- 
fahrers (16), wobei der Gassack (20) in einem Armaturenbrett (22) des Fahrzeugs (12) vor dem Beifahrersitz (18) 
35 montiert ist, wobei das System umfasst: 

eine Infrarotquelle (30) die einen Infrarotstrahl erzeugt, der auf den Beifahrersitz (18) gerichtet ist; 

einen Infrarotdetektor (34), der auf Strahlung anspricht, die von GegenstSnden auf dem Beifahrersitz reflektiert 

wird, wobei der Detektor (34) Signale erzeugt, die eine Abbildung der GegenstSnde auf dem Beifahrersitz (18) 

40 anzeigen, die auf der reflektierten Infrarotstrahlung beruht; und 

einen Prozessor (52), der auf die Abbildung von dem Detektor (34) anspricht, wobei der Prozessor (52) Ge- 
sichtserkennungssoftware enthait, die Gesichtsmerkmale eines Beifahrers (16) identifiziert, erfasst und ver- 
folgt, wobei der Prozessor (52) den Gassack (20) dazu veranlasst, sich bei einem Aufprallereignis zu entfalten, 
wenn der Beifahrer (16) in dem Beifahrersitz (18) festgestellt wird und in einem vorherbestimmten Abstand 

45 von dem Armaturenbrett (22) entfernt ist; 

dadurch gekennzeichnet, dass der Prozessor (52) den Abstand des Beifahrers (16) von dem Armaturenbrett 
(22) durch den Trennungsabstand zwischen zwei Stellen auf dem Gesicht des Beifahrers ermittelt. 

so 2. Das System gemSfc Anspruch 1 , wobei der Prozessor (52) die Augen des Beifahrers verfolgt und den Abstand 
des Beifahrers (16) von dem Armaturenbrett (22) anhand des Trennungsabstands der Augen des Beifahrers er- 
mittelt. 

3. Das System gemSIJ Anspruch 1 , wobei die Infrarotquelle (30) eine Ansammlung (28) von Infrarotlicht ausstrah- 
55 lenden Dioden ist. 

4. Das System gemSft Anspruch 3, wobei der Infrarotdetektor (34) eine elektronische Videokamera ist. 
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5. Das System gemSR Anspruch 4, wobei die Ansammlung (28) von Dioden (30) und die elektronische Kamera (34) 
als eine allein stehende Einheit (26) bereitgestellt werden, die an das Armaturenbrett (22) auf der Vorderseite des 
Beifahrersitzes (1 8) montiert ist. 

6. Das System gemaft Anspruch 1 , ferner einen Infrarotfilter (36) umfassend, der vor dem Detektor (34) angeordnet 
ist. 

7. Das System gemaft Anspruch 1 , wobei der Infrarotdetektor (34) eine Pixelmatrix (90) aus Photodioden (92) enthait. 

8. Das System gemSR Anspruch 1 , wobei die Infrarotquelie (30) fur eine vorbestimmte Zeit zu vorbestimmten Inter- 
vallen gepulst wird. 

9. Das System gemSfc Anspruch 8, wobei die gepulste Quelle (30) und der Detektor (34) derail synchronisiert sind, 
dass eine Differenz aufeinanderfolgender Rahmen eine von Umgebungslichtschwankungen freie Abbildung dar- 
stellt. 

10. Das System gemaii Anspruch 9, wobei die Differenz aufeinanderfolgender Rahmen direkt von dem Detektor (34) 
durchgefuhrt wird. 

11. Das System gemaB Anspruch 1, wobei Rahmen von Daten in dem Detektor (34) gespeichert werden, wenn die 
Quelle (30) eingeschaltet ist und die Quelle (30) ausgeschaltet ist, um sichtbares Licht zu subtrahieren. 

12. Das System gemaB Anspruch 1 , wobei der Prozessor (52) eine Datenbank enthait, die Information Ober bestimmte 
Einzelpersonen speichert, wobei der Prozessor (52) die Datenbank verwendet, um den Beifahrer (16) zu identifi- 
zieren. 

13. Ein Verfahren zum Bestimmen, ob ein Beifahrer-Gassack (20) in einem Fahrzeug (12) entfaltet werden soil, wobei 
das Verfahren die Schritte umfasst: 

Richten eines Strahls von Infrarotstrahlung in Richtung auf einen Beifahrersitz (18) des Fahrzeugs (12); 
Feststellen reflektierter Infrarotstrahlung von Objekten in dem Beifahrersitz (18); 

Erzeugen von Signalen, die eine Abbildung der Objekte in dem Beifahrersitz (1 8) anzeigen, die auf reflektierter 
Infrarotstrahlung beruht; 

Verarbeiten der Abbildungssignale unter Verwendung der Gesichtserkennungssoftware, um zu bestimmen, 
ob eine Person (16) in dem Beifahrersitz (18) vorhanden ist; 

Ermitteln eines Abstands der Person (16) in dem Beifahrersitz (18) von dem Armaturenbrett (22); und 
Ermitteln, ob der Gassack (20) ausgelost werden soli, abhSngig davon, ob ein Gesicht einer Person wahrge- 
nommen wird und dem Abstand der Person von dem Armaturenbrett (22); 

gekennzeichnet durch den Schritt des Ermitteins des Abstands der Person (16) von dem Armaturenbrett (22), 
anhand des Trennungsabstands zwischen zwei Stellen auf dem Gesicht der Person. 

14. Das Verfahren gemaB Anspruch 1 3, wobei der Schritt des Verarbeitens das Erkennen und Ermitteln eines Gesichts 
einer Person anhand seiner Augen enthait. 

15. Das Verfahren gemaB Anspruch 13, wobei der Schritt des Ermitteins, ob der Gassack (20) ausgelbst werden soil, 
das Ermitteln enthait, ob der Gassack (20) aufgrund des Abstands der Person (16) von dem Detektor (34) und/ 
Oder der GroBe der Person (16), sanft ausgelost Oder hart ausgelost werden soli. 

16. Das Verfahren gemaB Anspruch 13, wobei der Schritt des Ausrichtens des Strahlungsstrahls das Pulsieren des 
Strahlungsstrahls enthait. 

17. Das Verfahren gemaB Anspruch 16, ferner umfassend den Schritt der Anwendung einer Rahmendifferenzierungs- 
technik, um Umgebungsstrahlung von den erfassten Bildem zu subtrahieren. 



9 



EP 1 167 126 B1 



Revendications 

1. Systeme destine a deployer dans un vehicule (12) un coussin gonflable (20) pour passager, destine a maintenir 
un passager (16), ledit coussin gonflable (20) etant monte dans un tableau de bord (22) du vehicule (12) face au 
siege (18) du passager, ledit systeme comprenant : 

une source infrarouge (30) gen6rant un faisceau infrarouge oriente dans la direction du siege (18) du 
passager ; 

un detecteur infrarouge (34) sensible au rayonnement infrarouge refiechi par les objets se trouvant sur le siege 
(18) du passager, ledit detecteur (34) generant des signaux indicatifs d'une image des objets se trouvant sur 
le siege (18) du passager en se basant sur le rayonnement infrarouge refiechi ; et 

un processeur (52) sensible a I'image delivree par le d6tecteur (34), ledit processeur (52) comprenant un 
logiciel de reconnaissance de visage qui identifie, acquiert et suit les caracteristiques faciales du passager 
(1 6), ledit processeur (52) entraTnant le deploiement du coussin gonflable (20) en cas d'accident si le passager 
(1 6) est detecte sur le siege (1 8) du passager et s'il est a une distance predeterminee du tableau de bord (22); 

caracterise en ce que le processeur (52) determine la distance a laquelle se trouve le passager (16) par rapport 
au tableau de bord au moyen de ta distance de separation entre deux points du visage du passager. 

2. Systeme selon la revendication 1 , 

dans lequel le processeur (52) suit les yeux du passager et determine la distance a laquelle se trouve le passager 
(16) par rapport au tableau de bord (22) au moyen de la distance de separation entre ies yeux du passager. 

3. Systeme selon la revendication 1 , 

dans lequel la source infrarouge (30) est une grappe (28) de diodes emettant de la lumiere infrarouge. 

4. Systeme selon la revendication 3, 

dans lequel le detecteur infrarouge (34) est une camera video electronique. 

5. Systeme selon la revendication 4, 

dans lequel la grappe (28) de diodes (30) et la camera electronique (34) sont fournies sous la forme d'une unite 
unique (26) montee sur le tableau de bord (22) face au siege (18) du passager. 

6. Systeme selon la revendication 1 , 

comprenant en outre un filtre infrarouge (36) place face au detecteur (34). 

7. Systeme selon la revendication 1 , 

dans lequel le detecteur infrarouge (34) comprend un reseau de pixels (90) de photodiodes (92). 

8. Systeme selon la revendication 1 , dans lequel la source infrarouge (30) est pulsee pendant un temps predetermine 
a des intervalles predetermines. 

9. Systeme selon la revendication 8, 

dans lequel la source puls6e (30) et le detecteur (34) sont synchronises de telle sorte qu'une difference de frames 
successives represente une image exempte de variations de lumiere ambiante. 

10. Systeme selon la revendication 9, 

dans lequel ladite difference de frames successives est obtenue directement par le detecteur (34). 

11. Systeme selon la revendication 1 f 

dans lequel les trames de donnees sont memorisees dans ie detecteur (34) quand la source (30) fonctionne et 
quand la source (30) ne fonctionne pas, de maniere a soustraire la lumiere visible. 

12. Systeme selon la revendication 1, 

dans lequel le processeur (52) comprend une base de donnees qui memorise les informations se rapportant a 
des indtvidus specifiques, ledit processeur (52) utilisant la base de donnees pour identifier le passager (16). 

13. Precede destine a determiner s'il faut ou non deployer un coussin gonflable (20) pour passager dans un vehicule 
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(12), ledit procede comprenant les etapes consistant a : 

orienter un faisceau de rayonnement infrarouge dans la direction d'un siege (1 8) de passager du vehicule (1 2) ; 
detecter le rayonnement infrarouge reflechi par les objets se trouvant sur le siege (18) du passager ; 
generer des signaux indicatifs d'une image des objets se trouvant sur le siege (1 8) du passager en se basant 
sur le rayonnement infrarouge reflechi ; 

traiter les signaux d'image au moyen d'un logiciel de reconnaissance de visage afin de determiner s'il y a ou 
non une personne (16) sur le siege (18) du passager ; 

determiner une distance entre la personne (1 6) se trouvant sur le siege (1 8) du passager et le tableau de bord 
(22) ; et 

determiner s'il faut ou non declencher un coussin gonflable (20) en fonction de ce qu r un visage de personne 
est ou non detecte et de la distance entre la personne et le tableau de bord (22) ; 

caracterise par I'etape consistant a determiner la distance a laquelle la personne (16) estdu tableau de bord (22) 
au moyen de la distance de separation entre deux points du visage de la personne. 

14. Procede selon la revendication 13, 

dans lequel I'etape de traitement comprend la reconnaissance et la determination d'un visage de personne a I'aide 
de son oil ou de ses yeux. 

15. Procede selon la revendication 13, 

dans lequel Tetape consistant a determiner s'il faut ou non declencher le coussin gonflable (20) comprend la 
determination du choix entre un declenchement tranquille et un declenchement brutal du coussin gonflable (20) 
en fonction de la distance entre la personne (16) et le detecteur (34) et/ou de la taille de la personne (16). 

16. Procede selon la revendication 13, 

dans lequel I'etape d'orientation du faisceau de rayonnement comprend le declenchement par impulsions du fais- 
ceau de rayonnement. 

17. Procede selon la revendication 16, 

comprenant en outre I'etape consistant a employer une technique de differentiation de trame pour soustraire le 
rayonnement ambiant des images detectees. 
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